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(54) Authorizing the production of visual images from digital images 


(57) A method for authorizing the making of a visual 
image from a digital image includes receiving the digital 
image having embedded authorization information, ex- 
tracting the authorization infonnation from the digital im- 


age, and verifying that the extracted embedded author- 
ization information permits an imaging device to form 
the visual image of the digital image. After the verifying 
step, the imaging device forms the visual image from 
the digital image. 


10 


30 


Image Data 
Base 


Networic 
Server 


V 


50 

/- 

Account 
Database 


Network 
Server 


20 


150 


Processor 


Kiosic 


CM 
< 

Csl 

co 


0. 

liJ 


80 

i / /70 


Processor 


Printer 


Card 
Reader 


160 


Card 
Reader 


V 


250 


Account 
Database 


Network 
Server 


40 


00 


110 


240 


Processor 


Display 
Device 


85 


Printed 
Image 


190 

i /.^ 180 


Processor 


Scanner 


Card 
Reader 


\ 

120 


H Card 
Reader 1 


185 


Printed 
Image 


90 


195 


FIG. 1 


Printed by Jouve. 75001 PARIS (FR) 


5T AVAILABLI 


1 


EP1 137 244 A2 


2 


Description 

[0001 ] The present invention relates to the authoriza- 
tion of producing visual images from digital images. 
[0002] Images can be viewed by many different types 
of imaging devices: they can be displayed on a monitor 
such as a liquid crystal display (LCD), a cathode ray tub 
monitor (CRT), or an organic light emitting diode display 
(OLED). They can be printed on a reflective or transpar- 
ent receiver by a printer. They can also be projected onto 
a screen using a projector to present a static image or 
motion images. The imaging devices are usually located 
at different sites. In addition, many of the digital images 
are protected by copyright. Adequate authorization 
methods need to be set up for the users to get permis- 
sion to use the digital images. Modern communication 
and computing technologies provide convenience for 
using digital images at different locations. The digital im- 
ages can be used to produce images on a display or 
printing images on receivers. 

[0003] An object of the present invention is to provide 
an effective authorization method for using digital imag- 
es. 

[0004] This object is achieved by a method for author- 
izing the making of a visual image from a digital Image, 
comprising the steps of: 

a) receiving the digital image having embedded au- 
thorization infomnation; 

b) extracting the authorization infomnation from the 
digital image; 

c) verifying that the extracted embedded authoriza- 
tion information permits an imaging device to form 
the visual image of the digital image; and 

d) after the verifying step using the imaging device 
to form the visual image from the digital image. 

[0005] An advantage of the present invention is that 
the authorization of the use of digital images can be pro- 
vided for users at different and remote locations. 
[0006] A feature of the present invention is that the 
authorization information is embedded in the digital im- 
age and is therefore an integral part of the digital image. 
[0007] Another feature of the present invention is that 
the permission to use an digital image can be readily 
facilitated. 

[0008] FIG. 1 illustrates the system for providing the 
service of producing visual images using digital images 
in accordance with the present invention. 
[0009] This invention relates to a method for author- 
izing producing a visual image on an imaging device. In 
this disclosure, the term imaging device can include any 
devices that can form a visual image, for example, a dis- 
play device, a printer or a projector. A display device 
can be, for example, a liquid crystal device (LCD), a 
cathode ray tub monitor (CRT), or an organic light emit- 
ting diode display (OLED). The monitor can be self- 
standing or hand held. A projector projects a static im- 


age or motion images on a screen, which are exempli- 
fied by a LCD light valve or digital mirror technologies. 
A printer can be an ink jet printer, a thermal resistive 
printer, a laser (electrophotographic) printer, or a digital 
5 silver halide printer. 

[0010] FIG. 1 illustrates the imaging and authorization 
system 10 for providing the service of producing visual 
images using digital images in accordance with the 
present invention. The imaging and authorization sys- 
10 tem 1 0 includes a first network server 20 having an im- 
age database 30, a second network server 40 having 
an account database 50, a printer 70 having a processor 
80 for producing printed image 90, a display device 100 
having a processor 1 1 0, and an imaging kiosk 1 40 hav- 
^5 ing a processor 1 50. The imaging and authorization sys- 
tem 10 can also include a scanner 180 having a proc- 
essor 1 90- The scanner 1 80 scans a printed image 1 95. 
[0011] The imaging devices can be located adjacent 
to each other or installed at different locations such as 
20 shopping malls, airports ortrain stations, movie cinema, 
entertainment parks, orsupennarkets. The first network 
server 20 having the image data base 30 is installed at 
a service provider that provides the digital images that 
are used at various imaging devices. The imaging de- 
25 Vices can also include a compact disc (CD) writer for 
recording the digital image on a recordable CD such as 
a digital versatile disc (DVD) and versatile compact disc 
(VCD). The account database 50 at the second network 
server 20 stores and manages the account information 
30 of the service provider for collecting the payment for the 
usage of the imaging devices. 
[001 2] The imaging devices described above produce 
visual images in response to the request of the users. 
The visual image can be produced by displaying on a 
35 monitor or by printing on a reflective or transmissive re- 
ceiver such as paper or synthetic material. The user can 
select at least one property for producing such visual 
images. For the printer 70, for example, the selectable 
image properties includes image size, the number of the 
40 visual images, the properties of the imaging device in- 
cluding the printertype, the printing resolution, the prop- 
erties of the colorants, the receiver type, and the print 
finish. The selectable properties can also include imag- 
ing processing operations for enhancing the features or 
45 the quality of the visual images. The image processing 
operations include adjusting tone scale, adjusting color 
balance, adjusting color saturation, reducing red-eye, 
sharpening of softening the image, reducing blur, crop- 
ping, zooming, inserting the digital image into an image 
50 template, adding text or annotation into the image, and 
retouching the image. 

[0013] A communication channel 200 electronically 
connects the network servers 20 and 40, the printer 70, 
the display device 100, the imaging kiosk 140, and the 
55 scanner 180 for providing communication between 
these devices. The communication channel 200 can ex- 
ist in different physical and software forms. For example, 
the communication channel 200 can include an Internet 
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or a local network. They can be built with an optical-fiber 
cable, a co-axial cable, telephone line, satellite trans- 
mission system, and wireless radio-wave transmission. 
The communication over the communication channel 
200 can use different protocols such as the World Wide 
Web, and file transfer protocol (FTP). 
[001 4] The imaging and authorization system 1 0 also 
includes a third network sen/er 240 associated with a 
bank which holds the account of a user of the imaging 
devices. The third network server 240 includes an ac- 
count database 250 that stores and manages the ac- 
count information for the user of the imaging devices 
such as the printer 70, the display device 100, the im- 
aging kiosk 140, and the scanner 180. 
[0015] The image database 30 stores a plurality of 
digital images having embedded image-access infor- 
mation. The image-access information includes author- 
ization information. The authorization information is 
used for permitting a user to produce a visual image at 
an imaging device. The authorization infomnation may 
permit the use with and without charge of the digital im- 
age for forming a visual image on an imaging device. 
The authorization information may also prohibit the use 
of the digital image for certain applications. The author- 
ization information can also authorize the operation of 
a device. For example, the authorization information can 
authorize the copying operation of a compact disc writer 
to copy the digital image files from a memory to a re- 
cordable disc. The authorization information can author- 
ize the use of a software stored in an imaging device or 
a computer. 

[0016] The image access information can also in- 
clude information about the receiver of payment for the 
imaging services using these digital images. An exam- 
ple of the receiver of payment is the service provider for 
the imaging services. The image-access infomnation 
can also include the web or e-mail address of the receiv- 
er of the payment such as the service provider. In the 
present invention, an image service can include captur- 
ing, processing, printing, copying, scanning, and repro- 
ducing of images in an electronic device or to or from a 
receiver. 

[0017] For providing imaging sen/ices to the user at 
an imaging device such as the printer 70, the display 
device 1 00, imaging kiosk 1 40 or a scanner 1 80, the im- 
aging device receives digital images from the image da- 
tabase 30, Image-access infomnation is embedded in 
the digital image. The embedded image-access infor- 
mation is preferably invisible when a visual image is pro- 
duced from the digital image. After the digital images 
are received, the embedded image-access infomnation 
is extracted from the digital images, as described below, 
in the processors 70, 1 00, 1 40. 1 80 that are located with- 
in or near each of the imaging devices. 
[0018] Each of the printer 70, the display device 100, 
the imaging kiosk 140, and the scanner 180 is respec- 
tively connected to a card reader 85, 120, 160, 185, 
which are in turn connected with the information channel 


200 The card readers 85, 120, 160, 185 can read ac- 
count information by scanning a credit card or a bank- 
card corresponding to the third network server 240 or 
from manual input of an operator. The account informa- 
5 lion includes an identifier such as a bank account 
numberthat specifies the user's bank account. The pay- 
ment of the imaging service is to be debited toward the 
user's account. The payment is accomplished by trans- 
ferring funds from the identifier specified account to the 
10 receiver of payment. The bank card readers 85, 120, 
160, or 185 can communicate with the second network 
server 40 and the third network server 240 through the 
communication channel 200. The bank card readers 85, 
120, 160, or 185 manage and record payment transac- 
ts tions for the imaging services using the receiver-ac- 
count information extracted from the digital image and 
the user-account information read from a bankcard. 
[0019] In accordance with the present invention, the 
payment billed to the user's account is dependent on 
20 the type of imaging service requested by the user. The 
image assess infomnation embedded in the digital im- 
age sent from the image database 30 to the imaging de- 
vices can include selectable image properties for the . 
imaging service. Different imaging properties result in 
25 different amounts of payment from the user's account. 
[0020] The selectable image properties can include a 
plurality of imaging programs that provide features to the 
visual image to be produced on a receiver or a monitor. 
For example, the imaging programs can include adjust- 
30 ing tone scale, adjusting color balance, adjusting color 
saturation, reducing red-eye, sharpening of softening 
the image, reducing blur, cropping, zooming, inserting 
the digital image into an image template, adding text into 
the image, and retouching the image. The selectable im- 
35 age properties can also include image size and the 
number of the visual images to be produced. The se- 
lectable image properties can also include properties of 
the imaging device such as the printer or the scanner 
type, the printing resolution, the properties of the color- 
40 ants, the receiver type, and the type of print finish. These 
device properties often determine the quality of the vis- 
ual images as well as the cost to the service provider. 
For example, an ink image produced on a photo quality 
receiver by a 6-ink ink jet printer will cost more than an 
45 ink image printed on a plain paper using a 4-ink ink jet 
printer. 

[0021] Before the visual image is finalized, the user 
can preview the improved (that is processed or modi- 
fied) image on a monitor. The user can order the final 

50 visual image such as the number or the size of the visual 
images according to her satisfaction with the preview 
image. After the order is made for the imaging service, 
the proper charge is debited from the user's account to 
the receiver of the payment based on the selected im- 

55 age property. The visual image having the image prop- 
erty is subsequently produced on the imaging device. 
[0022] The embedding and extraction of image-ac- 
cess information in the digital image is now described. 
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A digital image l(x,y) is stored In image database 30. 
The image-access information is embedded into the dig- 
ital image l(x,y) by modifying the pixel values in t(x,y) to 
produce a modified digital image l'(x,y) having the em- 
bedded image-access infonnation. The image-access 
information can be encrypted before embedding. 
[0023] The embedding of the image-access informa- 
tion starts with producing a message image M(x,y). The 
message image M{x,y) can include alphanumeric or 
graphic information associated with the image-access 
information. A carrier image C(x,y) is also generated 
with a unifomn or flat Fourier amplitude spectrum and a 
phase spectrum generated using a random number 
generator for each phase component. The random 
phase is required to distribute the message image to 
make the message invisible and unreadable to human 
eyes. 

[0024] The message image M(x,y) and the carrier im- 
age C(x,y) are then convolved to form a distributed sig- 
nal S(x,y). 


S{x,y)^M{x,yrC{x,y) 


(1) 


In eqn. (1 ), the symbol denotes the mathematical op- 
eration of convolution, for example, a circular convolu- 
tion. 

[0025] The distributed signal S(x,y) is next added to 
the digital image l(x,y) to produce a modified digital im- 
age l'(x,y) carrying the embedded information: 


/'(X. y)= t{x, y) + aS{x, y) 


(2) 


The distributed signal S(x,y) is scaled by a scale factor 
a to maximize the signal of the embedded image-access 
information while ensuring the invisibility of the distrib- 
uted message in the modified digital image ('(x.y). That 
is, the value of a- can also be chosen for optimizing im- 
age quality. 

[0026] The reliability of extracting the embedded in- 
formation can be improved by superimposing a plurality 
of blocks of distributed signals S(x,y) to each color plane 
of the processed digital image l(x,y). Each of the blocks 
can be, for example, 64 x 64, 128 x 128, or 256 x 256 
pixels in size. For a 300 dpi or 600 dpi printer, these 
blocks represent a small area (smaller than 1 square 
inch) on the printed identification document. The redun- 
dancy in the distributed signals S(x,y) increases the sig- 
nal-to-noise ratio in the extraction of embedded infor- 
mation from modified digital image r(x,y). In the present 
invention, the term extracting is used to refer the action 
of retrieving information from an image or visual textual 
information. 

[0027] The modified digital image l'(x,y) is transferred 
via the communication channel 200 to an imaging de- 
vice such as the printer 70. The image-access informa- 
tion is extracted from the modified digital image l'(x,y) 


in the processors 70, 100, 150, 180. The extraction of 
the embedded image-access information from the mod- 
ified image r(x,y) involves cross-correlating r(x.y) with 
the carrier image C(x,y) to obtain the message image M 
5 (x,y). If the image-access information is encrypted, the 
image-access information is subsequently decrypted 
from the extracted infonnation by the processors 70, 
100, 150, 180 at the imaging devices. 
[0028] The authorization infonnation extracted from 
10 the digital image as part of the image-access informa- 
tion includes a description whether and how the digital 
image can be used on an imaging device. For example, 
the authorization infonnation may permit the use of the 
digital image for forming a visual image on an imaging 
15 device with or without charge to the user. The authori- 
zation information may also prohibit the use of the digital 
image for certain applications. The authorization infor- 
mation can also authorize the operation of a device oth- 
er than the fonnation of a visual image. For example, 
20 the authorization information can authorize the copying 
operation of a compact disc writer to copy the digital im- 
age files from a memory to a recordable disc. The au- 
thorization information can authorize the use of a soft- 
ware stored in an imaging device or a computer. 
25 [0029] The extracted authorization information can be 
compared with pre-stored information in an electronic 
memory connected to the imaging device. The pre- 
stored information can include a description of the types 
of Imaging service that can be provided by the specific 
30 imaging device. The pre-stored infonnation can also in- 
clude a key for decrypting the encrypted authorization 
infomnatlon. The pre-stored infonnation can also include 
infonnation input from the user of the imaging device 
such as identification of the user. The authorization in- 
35 formation sometimes defines which users are author- 
ized to use the digital image to fomn visual images. 
These users may have made payment arrangement (for 
example monthly charges or membership charges) or 
established credits with the service provider 
-^0 [0030] Based on the authorization infonnation and the 
comparison with the pre-stored Information the Imaging 
device can approve or deny the use of the digital image 
for forming visual images. 

[0031] The data embedding technique disclosed in 
45 US-A-5,636.292 Is compatible with the present inven- 
tion. The disclosures in these references are hereby in- 
corporated In regard to embedding and extracting im- 
age-access infonnation in the digital images stored in 
the Image database 30. 
50 [0032] A computer program product may include one 
or more storage medium, for example; magnetic storage 
media such as magnetic disk (such as a floppy disk) or 
magnetic tape; optical storage media such as optical 
disk, optical tape, or machine readable bar code; solld- 
55 state electronic storage devices such as random access 
memory (RAM), or read-only memory (ROM); or any 
other physical device or media employed to store a com- 
puter program having instructions for practicing a meth- 
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od according to the present invention. The computer 
program can be stored on a storage medium in or con- 
nected to the imaging device or in one or more of the 
network servers. 

[0033] Other features of the invention are included be- 
low. 

[0034] The method further including displaying the 

authorization infonnation on the monitor. 

[0035] The method wherein the imaging device is a 

printer which produces the visual image on a receiver. 

[0036] The method wherein the imaging device is a 

display device or a projector which displays the visual 

image. 

[0037] The method wherein the imaging device in- 
cludes a compact disc writer. 

[0038] The method wherein the imaging device is a 
kiosk which processes, displays and prints the digital im- 
age. 

[0039] The method further including previewing the 
digital image on a monitor before selecting image prop- 
erties. 

PARTS LIST 
[0040] 

1 0 imaging and authorization system 

20 first network server 

30 image database 

4U second network server 

50 account database 

70 printer 

80 processor 

85 card reader 

90 printed image 

100 display device 

110 processor 

1 20 card reader 

140 kiosk 

150 processor 

1 60 card reader 

180 scanner 

1 85 card reader 

190 processor 

195 printed image 

200 communication channel 

240 third network server 

250 account database 


Claims 

1 . A method for authorizing the making of a visual im- 
age from a digital image, comprising the steps of: 

a) receiving the digital image having embedded 
authorization information; 

b) extracting the authorization information from 


the digital image; 

c) verifying that the extracted embedded au- 
thorization infonnation pemnits an imaging de- 
vice to fomn the visual image of the digital im- 

5 age; and 

d) after the verifying step using the imaging de- 
vice to form the visual image from the digital 
image. 

10 2. A method for authorizing the making of a visual im- 
age from a digital image, comprising the steps of: 

a) storing the digital image having embedded 
authorization infonnation; 
15 b) extracting the authorization information from 

the digital image; 

c) addressing the memory and causing the dig- 
ital image to be delivered to an imaging device 
at a remote location; 
20 d) verifying that the extracted embedded au- 

thorization information permits the imaging de- 
vice to fomn the visual image of the digital im- 
age; and 

e) after the verifying step using the imaging de- 
25 vice to form the visual image from the digital 

image. 

3. A method for authorizing and making payment for 
the making of a visual image from a digital image, 
30 comprising the steps of: 

a) storing the digital image having embedded 
authorization infonnation and image-access in- 
formation; 

35 b) addressing the memory and causing the dig- 

ital image to be delivered to an imaging device 
at a remote location; 

c) extracting the authorization information and 
the image-access information from the digital 

40 image, the image-access information including 

the receiver of payment; 

d) verifying that the extracted embedded au- 
thorization information permits the imaging de- 
vice to form the visual image of the digital im- 

45 age; 

e) making payment to the receiver of payment; 
and 

f) after the verification step using the imaging 
device to form the visual image from the digital 

50 image. 

4. A method for producing a visual image having se- 
lected properties and for providing payment there- 
for, comprising the steps of; 

a) storing the digital image having embedded 
image-access information in an electronic 
memory, the image-access information includ- 
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ing the receiver of payment and selectable im- 
age properties for which different payments are 
to be made; 

b) accessing the electronic memory and ex- 
tracting the image-access information from the 5 
digital image; 

c) selecting at least one property from the se- 
lectable Image properties for producing the vis- 
ual image; 

d) making payment to the receiver of payment 10 
based on at least in part one selected image 
property; and 

e) producing the visual image in response to 
the selected property and the digital image. 


8. 


The method of claim 1 wherein the step of verifying 
includes approving or denying the making of the vis- 
ual image based on whether the digital image is au- 
thorized. 

The method of claim 1 wherein the step of verifying 
includes comparing the authorization infomiation to 
a pre-stored information in an electronic memory 
connected to the imaging device. 

The method of claim 1 wherein the embedded au- 
thorization information is invisible with unaided 
eyes. 

A computer program product according to the meth- 
od of claim 1 . 


15 


20 


35 


9. A computer program product according to the meth- 
od of claim 2. 

10. A method for authorizing the operation of a device, 
comprising the steps of: 

a) receiving the digital image having embedded 
authorization information; 40 

b) extracting the authorization infonnation from 
the digital image; 

c) verifying that the extracted embedded au- 
thorization information permits the operation of 
the device; and 45 

d) after the verifying step operating the device. 
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